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Abstract 

We prove the asymptotic normality of the kernel density estimator (introduced 
by Rosenblatt (1956) and Parzen (1962)) in the context of stationary strongly 
mixing random fields. Our approach is based on the Lindeberg's method rather 
than on Bernstein's small-block-large-block technique and coupling arguments 
widely used in previous works on nonparametric estimation for spatial processes 
(see [1], [5], |llj . |21j). Our method allows us to consider only minimal conditions 
on the bandwidth parameter and provides a simple criterion on the (non-uniform) 
strong mixing coefficients which do not depend on the bandwith. 

AMS Subject Classifications (2000): 62G05, 62G07, 60G60. 
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1 Introduction and main result 

The kernel density estimator introduced by Rosenblatt [19j and Parzen [T7] has received 
considerable attention in nonparametric estimation of probability densities for time 
series. If (Xj)j 6 z is a stationary sequence of real random variables with a marginal 
density / then the kernel density estimator of / is defined for any positive integer n 



and any x in R by 

where K is a probability kernel and the bandwidth b n is a parameter which converges 
slowly to zero such that nb n goes to infinity (the bandwidth determines the amount 
of smoothness of the estimator). For small b n we get a very rough estimate and for 
large b n a smooth estimate. The literature dealing with the asymptotic properties of /„ 
when the observations [Xj)i & % are independent is very extensive (see Silverman [20J). 
In particular, Parzen |T7] proved that when (Xi) ie z is i.i.d. and the bandwidth b n 
goes to zero such that nb n goes to infinity then (nb n ) 1 ^ 2 (f n (xo) — E/ n (xo)) converges 
in distribution to the normal law with zero mean and variance f(xo) J R K 2 (t)dt. This 
result was recently extended by Wu [23] for causal linear processes with i.i.d. inno- 
vations under the same conditions on the bandwidth. Bosq, Merlevede and Peligrad 
[3J established a central limit theorem for the kernel density estimator f n when the 
sequence (^Q)igz is assumed to be strongly mixing but the bandwith parameter b n is 
assumed to satisfy b n > Cn' 1 ' 3 logn (for some positive constant C) which is stronger 
than the bandwith parameter assumption in [17] and [23]. In this paper, we are go- 
ing to establish Parzen's central limit theorem (see Theorem [1]) for random variables 
which show spatial interaction (random fields). The problem is not trivial since 7L d 
do not have a natural ordering for d > 2 and consequently classical techniques avail- 
able for one- dimensional processes do not extend to random fields. In particular, the 
martingale-difference method (Wu |23j) for time series seems to be difficult to apply in 
the spatial context. Over the last few years nonparametric estimation for random fields 
(or spatial processes) was given increasing attention stimulated by a growing demand 
from applied research areas (see Guyon [10J). In fact, spatial data arise in various areas 
of research including econometrics, image analysis, meteorology, geostatistics... Key 
references on nonparametric estimation for random fields are Biau [T], Carbon et al. 
[I], Carbon et al. [5], Hallin et al. [11] , [12] . Tran [21] . Tran and Yakowitz [22] and 
Yao [21] who have investigated nonparametric density estimation for random fields and 
Biau and Cadre [2], El Machkouri [8], El Machkouri and Stoica [9], Hallin et al. [13] 
and Lu and Chen [H], [15] who have studied spatial prediction and spatial regression 
estimation. 

Let d be a positive integer and let (Xi) ieZ d be a field of identically distributed real 
random variables with a marginal density /. Given two a-algebras U and V of J 7 , 
different measures of their dependence have been considered in the literature. We are 
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interested by one of them. The a-mixing coefficient has been introduced by Rosenblatt 
02] defined by 

a(U,V) = sup{|P(ADS) -¥(A)¥(B)\ , AeU, B G V}. 

In the sequel, we consider the (non-uniform) strong mixing coefficients ati t00 (n) defined 
for each positive integer n by 

a 1)00 (n) = sup{a(a(X fe ), T v ), k G Z d , V C Z d , p{T,{k}) > n}, 

where = cr(Xj ; j 6 T) and the distance p is defined for any subsets I\ and T 2 
of Z d by p(ri,r 2 ) = min{|i - j\, i G r x , j G T 2 } with |i - j| = maxi< s < d \i s - j s \ 
for any i and j in Z d . We say that the random field (Xi) i€Z d is strongly mixing if 
lim„^._|_oo ati jOQ (n) = 0. The class of mixing random fields in the above sense is very 
large (one can refer to Guyon [10J or Doukhan [7] for examples) and we recall that 
Dedecker (6] obtained a central limit theorem for the stationary random field (Xi) ie7d d 
provided that Xq has zero mean and finite variance and 

/ai,oo(|fe|) 
Q 2 Xo (u)du < +oo 

where Qx is the quantile function defined for any u in [0, 1] by 

QxM = inf{t > ; P(|X | >t)< u}. 

We consider the density estimator of / defined for any positive integer n and any x in 
R by 

where b„ is the bandwidth parameter, A n denotes the set {1, n} d and K is a probabil- 
ity kernel. Our aim is to provide a sufficient condition on the strong mixing coefficients 
a 1)00 (n) for {n d b n ) 1/2 (f n (xi) -^f n {xi))i<i<k, (^i)i<i<k eR k , k e W, to converge in law 
to a multivariate normal distribution (Theorem [T]) under minimal conditions on the 
bandwidths (that is b n goes to zero and n d b n goes to infinity). 

We consider the following assumptions: 

(Al) The marginal probability distribution of each X^ is absolutely continuous with 
continuous positive density function /. 
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(A2) The joint probability distribution of each (X , Xj,) is absolutely continuous with 
continuous joint density /o,fc- 

(A3) K is a probability kernel with compact support and J R K 2 (u) du < oo. 

(A4) The bandwidth b n converges to zero and n d b n goes to infinity. 

Our main result is the following. 

Theorem 1 Assume that (Al), (A2) ; (A3) and (A4) hold and 

+00 

^2 m2d ~ 1 ai,oo(m) < +00. (1) 

771=1 

Then for any positive integer k and any distinct points x±, Xk in R, 

/ f n {x 1 )-Ef n (x 1 ) \ 



(A) 1/2 



n— >+oo 



+ M(P,V) (2) 



\ fn(xk) - E/ n (:cjk) / 

where V is a diagonal matrix with diagonal elements Va = f(xi) J R K 2 (u)du. 

Remark 1. A replacement of Kf n (xi) by f{xi) for any l<z<A;in([2])isa classical 
problem in density estimation theory. For example, if / is assumed to be Lipschitz and 
if L |u||K(w)|<iw < 00 then \Ef n (xi) — f(xi)\ = 0(b n ) and thus the centering W,f n (xi) 
may be changed to f(xj) without affecting the above result provided that n d b\ con- 
verges to zero. 

Remark 2. Theorem [1] is an extension of Theorem 3.1 by Bosq, Merlevede and 
Peligrad [3]. In fact, using a different approach, the authors obtained the same result 
for d = 1 with an additional condition on the bandwith parameter: there exists a 
positive constant C such that b n > Cn" 1 ' 3 log n. 

2 Proofs 

Proof of Theorem [TJ Without loss of generality, we consider only the case k = 2 
and we refer to x\ and X2 as x and y (x 7^ y). Let Ai and A2 be two constants such 
that \\ + A2 = 1 and denote 

S n = Xi(n d b n ) 1/2 (f n (x) - Ef n (x)) + A 2 (n d b n ) ^ (/„ (y) - Ef n (y)) = £4 

ieA n 
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where Aj = X 1 Z i (x) + X 2 Zi(y) and for any z in R, 

We consider the notations 

rj = {\\f{x) + Xlf(y))a 2 and a 2 = [ K 2 (u)du. (3) 

The proof of the following technical result is postponed to the annex. 

Lemma 1 E(Ajj) converges to rj and E|AoAj| = 0(b n ) for any i in Z d \{0}. 

In order to prove the convergence in distribution of S n to y/rjTQ where To ~ A/"(0, 1), 
we are going to follow the Lindeberg's method used in the proof of the central limit 
theorem for stationary random fields by Dedecker [6]. Let us note that several previ- 
ous asymptotic results for kernel density estimates in the context of spatial processes 
were established using the so-called Bernstein's small-block-large-block technique and 
coupling arguments which lead to restrictive conditions on the bandwith parameter 
(see for example jl], [5], |21]). Our approach seems to be better since we obtain 
a central limit theorem when the bandwith satisfies only Assumption (A2). 

Let \x be the law of the stationary real random field (X k ) k£Z d and consider the projec- 
tion 7To from M, zd to R defined by 7Cq(u) = ujq and the family of translation operators 
(T k ) k&d from R zd to M. zd defined by (T k (u))i = u i+k for any k G Z d and any u in M zd . 
Denote by B the Borel a-algebra of R. The random field (7r o T k ) keZ d defined on the 
probability space (R zd , B zd , (i) is stationary with the same law as (X k ) ke %d, hence, with- 
out loss of generality, one can suppose that (fi, J 7 , P) = (R zd , B %d , /x) and X k = HQoT k . 
On the lattice Z d we define the lexicographic order as follows: if i = (ii,...,id) and 
j = (jx,---,jd) are distinct elements of Z d , the notation % <i ex j means that either 
H < ji or for some p in {2, 3, d}, i p < j p and i q = j q for 1 < q < p. Let the sets 
{V t M ; i e Z d , M e N*} be defined as follows: 

Vl = {jeZ d ;j< lex i}, 

and for M > 2 

V t M = Vl n {j e Z d ; \i — j\ > M} where \i - j\ = max |i, - 
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For any subset T of Z d define J-? = u{Xi ; i e T) and set 

E M (Xi) = E(Xi\T V M), M e N*. 

Let g be a one to one map from [1, M] (1 N* to a finite subset of Z d and (£j)j e ^d a real 
random field. For all integers k in [1,M], we denote 

k M 

S 9(k) (0 = and S g(k) (0 = S ffl(0 

i=l i=fc 

with the convention 5^(0) (0 = *^g(M+i)(0 = 0. To describe the set A n = {1, n} d , we 
define the one to one map g from [1, n d ] D N* to A n by: (7 is the unique function such 
that g(k) <\ ex g(l) for 1 < k < I < n d . From now on, we consider a field (rj) igZ d of 
i.i.d. random variables independent of (Xi) i£Z d such that To has the standard normal 
law A/"(0, 1). We introduce the fields Y and 7 defined for any i in Z d by 

where 77 is defined by ([3]). 

Let h be any function from M to M. For < k < / < n d + 1, we introduce 
hk,i{Y) = h(S g (fy(Y) + SgyJ'j)). With the above convention we have that h k>n d+i(Y) = 
h(S g (fy(Y)) and also ho,i(Y) = h(S g l , l J'y)). In the sequel, we will often write h k j instead 
of h k; i(Y). We denote by Bf(R) the unit ball of C b 4 (M): h belongs to Bf(R) if and only 
if it belongs to C 4 (1R) and satisfies max <j<4 \\h® < 1. 



It suffices to prove that for all h in Bfi 

E(h (S g{nd) (Y))) >E(h(r ^n)). 

n— >+oo 

We use Lindeberg's decomposition: 

n d 

E(h (S g ( n d)(Y)) -hfoy/rj)) — y^^E {h kMX - h k -i tk ) . 

k=l 

Now, 

h>k,k+i ~ h k -i jk = h kjk +\ — + h k -i jk +i — h k -i jk - 

Applying Taylor's formula we get that: 

h k ,k+i - hk-i,k+i = Yg(k)h k _ ljk+1 + -^Yg\k)h k -i tk +i + Rk 
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and 

hk-i,k+i - h k -i,k = -lg(k)h k _ lik+1 - -l 2 g( k )h k -i,k+i + r k 

where \R k \ < Y g 2 {k) (l A \Y g(k) \) and \r k \ < 1 g{k) (l A \l g (k)\)- Since (Y, n)^ s ( fc) is indepen- 
dent of T ff (fc), it follows that 

E (7 fl (fc)^*-i,fc+i) =° and E (7j(fc)^*-i,fc+i) = E 
Hence, we obtain 

n d 

E (h(S g[nd) (Y)) - h (rov^)) = £ E(y ff(fc) / i ;_ li&+1 ) 

fc=i 

fc=i 

Let 1 < k < n d be fixed. Noting that A is bounded by 4||K|| 00 /\/6^ and applying 
Lemma [U we derive 

E l^l ^ = (( n 3^ n )l/ 2 ) 

and 

E l rfc l - n 3d/2 - 7^72 = ^ ^^3d/2 J ' 

Consequently, we obtain 

E K w + w) = °((^ + i) =o(1) ' 

Now, it is sufficient to show 

J5i.E ("W^ + e - i) %i) ) = 0. (4) 

First, we focus on J2k=i E (Xgifyh'k-i fe+i)- For a U ^ hi N* and all integer k in [1, n d ], 
we define 

£f = g([i, k] n N*) n v$, and sjf fc) (y) = ^ 35. 
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For any function \l/ from R to R, we define ^ k _n = ^(S^LJY) + S^m(7)) (we are 
going to apply this notation to the successive derivatives of the function h). 
For any integer n, we define 



m„ = max < 



h 1 



( \ 

1 y, iii d « li00 (|i|) 
[*[> r&5 



b 2 

n 



\ 



-i 



+ 1 



where [ . ] denotes the integer part function. The following technical result will be 
proved in the annex. 



m a n ->• oo, m^b n -»■ and -— - V} K| d ai,oo(|«|) -> 0. 



Lemma 2 Under Assumption (A4) and i/je mixing condition ([?]), we /iave 

1 

n n |i|>m„ 
Our aim is to show that 

k=l 

First, we use the decomposition 



(5) 



We consider a one to one map m from [1, PI N* to E™ n and such that \m(i) — 

g(k)\ < \m(i — 1) — g(k)\. This choice of m ensures that S m ^)(Y) and S' m (i_i)(y) are 
T^jmCij-ffWi-measurable. The fact that 7 is independent of y imply that 



s(*0 



Therefore 



E(y fl(Jfc) /i' fe +1) ( 7 )))=o. 



where 0; = ti (S m{i) (Y) + S£ (frfl) (7) 



|£m„j 



(6) 



Since 5 m (j)(y) and 5' m (j_ 1 )(y) are J 7 | m (i)- fl (fc)i -measurable, we can take the conditional 

a(,k) 
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expectation of Y g ^) with respect to T v \ m (i)- g (k)\ in the right hand side of (jBJ). On the 



SCO 



other hand the function h is 1-Lipschitz, hence 

\Qi — Oi-l\ < |^m(t)|- 

Consequently, 



|E(y s 



^_i))| <E\Y m(l) E 



m(i)-fl(fc)| (/s(*0 



and 



Hence, 



e f y g (&)/i fc "!" !fc+1 ) I < ^ E|r m(i) E| mW „ 9(fc) |(r 9{A .))|. 

i=i 



k+1 



k=l 



1 n« i^ri 

- E l A m»E| m (i)-g(fe)|(A s(fc) )| 

fc=l i=l 

< £ IIA.Ei^Ao)!!!. 



For any j in Z d , we have 

HA^CAo)!!! = Cov (|A,| (l %l (A )>o -I Em (A )<o) , A ^ 
So, applying Rio's covariance inequality (cf. |18| . Theorem 1.1), we obtain 



||A,E b1 (A )|| 1 <4 



«i,oo(|j|) 



Q\ o {u)du 



where Qa is defined by Qa (u) = inf{t > 0; P(|Ao| > t) < u} for any u in [0,1]. 
Since Ao is bounded by 4||K|| 00 /v&^, we have 

4||K|U 



Qa (u) < 



and ||A J -E li |(Ao)||i<?^P^a lf00 (|j|). 



Finally, we derive 



k=l 



< — i — 2^ a i.°°(wl) 

i i ... 

< «!H!L E u , Voo(U |) 



\j\>m n 



o(l) by ©. 
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Applying again Taylor's formula, it remains to consider 

Y g(k)(h k -l,k+l - fyfe-l,fc+l) = Yg(k)(Sg(k-l)(Y) - S^(Y))h k _ l>k+1 + R k , 

where \R' k \ < 2\Y g{k) (S g(k „ 1) (Y) - S^(Y))(1 A IS^-i)^) - S™fo(Y)\)\. Denoting 
W n = {-m n + 1, ...,m n - l} d and W* = W n \{0}, it follows that 



f>|4,| < 2E f|Ao| ( £ fl A E l A 

fc=i \ VieiVn / \ iew„ 

= 2E ( ( A » + E i a » a -i j (i A ^ 



E i Ai 



d/2 

<^E E ( A oi A <i) + 2 E E i A ° A *i 

^ E eci^d + 2 E e i a ° a *i since A ° < AJ §^ 



8E(Ag)||K|U / 4||K|U \ ^ 



= o(l) by®. 
So, we have shown that 



w 

l^oo E E ( 1 ff(*) /l *-l,fc+l - F ff(fc)(<V-l) - SJ5))>»*-l,fc+l) = °- 



n— >+oo 

fe=l 



In order to obtain (HI) it remains to control 

77 



Y 2 



2n d 



fc=i 

We consider the following sets: 

A^ = {ieA n ;p({i},9A n )>m n } and I™ n = {1 <i<n d ; g(i) e A™"}, 
and the function \1/ from M zd to R such that 

^(A) = A 2 + 2A o A * where W n = {-m n + l,...,m n -l} d . 
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For 1 < k < n d , we set D { k n) = v -^o T 9( - k \A). By definition of $ and of the set I™ n , 
we have for any k in I™ n 

* o T^\A) = A* + 2A g(k) (S 9{k ^(A) - S^ k] (A)). 



Therefore for k in 7™ n 



Since lim^+ooTO = 1, it remains to consider 



^ - % - 2y, w (s,<*-i)(r) - s^)(y)) 



Fx 

Applying Lemma [H we have 
Fx < 



/ n" 
\ k=l 



(n) 



< 



E ^E^ + i(4)-E(A^)) 

E fiE^ + i( A ^)- E ( A o)) 



+ |r ? -E(A2)| + 2 ^ E|A Aj 
+ o(l) + 0(m%), 



it suffices to prove that 



Ef^ECWAJw-ECAg)) 



fc=l 



goes to zero as n goes to infinity. Let M > be fixed. We have F 2 < F' 2 + F' 2 ' where 



k=l 



and 



E f^E^ + i (E*r(A^,)-E(Ag)) 



fc=l 



where we recall the noatation Km 0^(k) 
a Serfling type inequality which can be found in [16| . 



E ( A^l^yAf ). The following result is 
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Lemma 3 Let U and V be two a-algebras and let X be a random variable measurable 
with respect to U. Ifl<p<r<oo then 

||E(X|V) - E(X)\\ p < 2(2^ + 1) (a(W, V))H \\X\\ r . 

Applying Lemma [3] and keeping in mind that A is bounded by ^KH^/ yfb^, we derive 



F% < \\E M (Aq) - E(Ao)||! < 



96||K||^ 



ai,oo(M) 



In the other part, 



where 



n 

k=i 



4(M) = E (h" k \ k+l o T-^ (Ag - E A/ (Al)) 
since ft^i fc+1 o T~ 9 ( k > is J-^m -measurable and 

J2 W = |E ((hl hk+1 o T-«« - CW ° T ^ (fe) ) ( A o - Em (Ag)) 



JA, , 2 

d/2 I ^0 



n 



<E 2A J2 

\ \ \i\<M 

4||K|| 00 E(Ag) , 4||K|| 



< 



O 



{n d b n y/ 2 (n d b n y/ 2 



1 AfV&. 
+ 



^ ElAiAol since A < a .s 



\i\<M 



(n d b n y/ 2 n d l 2 



(by Lemma [T]) 



So, putting M = bn d 1 and keeping in mind that J2 m>0 rn 2d 1 afi )DO (ra) < +oo, we 
derive 



d-l 
,2d-l 



F 2 = 0(M 2d - 1 a li00 (M)) +0 



(n^ n ) 1/2 



o(l). 



The proof of Theorem [T] is complete. 



3 Annex 

Proof of Lemma\l\ For any i in Z d and any z in R, we note Kj(z) = K . So, if 

s and t belongs to M, we have 



E(Z (s)Z (t)) = -( E(K (s)K (t)) - EK (s)EK (t) 
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and 

lim lE(Ko(s)K (t))= lim f K(v)k(v + -r— ) /( s — vb n )dv = S st f(s) a 2 

n-^+oo b n rw+oo J R \ n J 

where 8 s t — 1 if s — t and S s t = if s ^ t. We have also 

lim -^EK (s)EK (t) = lim b n [ K(v) f (s - vb n )dv [ K(w)f(t-wb n )dw = 0. 

n-^+oo b n n^+oo J R J R 

So, we obtain 



E(A^) = XiE(Z^(x)) + KnZM) + 2X 1 X 2 E(Z (x)Z (y)) > rj. 

n— >+oo 

Let i ^ be fixed in Z d . We have 

ElAoAil < A?E|Z (a:)Z i (a:)|+A^E|Zo(j/)2'i(y)|+A 1 A2E|Zo(a;)Z i (i/)|+A 1 A2E|Zo(j/)2i(x)|. 

(7) 

For any s and t in R, 

E|Z ( S )^(t)| < -^-E|K (s)Kj(t)| + -^E|K (s)| E|K (t)|. 

Moreover, using Assumptions (A2) and (A3), we have 
1 

b n 



^E|Ko(s)|E|K (t)| =b n / \K(u)\f(s-ub n )du I \K(v)\f(t - vb n )dv = 0{b r , 



and 

-^E|K (s)Kj(t)| =b n [[ \K(w 1 )K(w 2 )\fo,i{s - wxb n ,t - w 2 b n )dwidw 2 = 0(b n ). 

On J JR2 

So, we obtain for any s and t in R 

nz { S )z l {t)\ = o{b n ). (* 

The proof of Lemma [T] is completed by combining ([7]) and ([8]) . 

Proof of Lemma [U First, goes to infinity since 6 n goes to zero and m n > 
For any positive integer m, we consider 

ip(m) = N d "i,oo(N)- 

|i|>m 
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i_ 

l. 2d 

<Jn 



Since the mixing condition ([T]) is equivalent to ^2 keIi d \k\ d oci tCO (\k\) < oo, we know that 
ip(m) converges to zero as m goes to infinity. Moreover, we have 



i 

L 2d 
Jn 



+ 2% n } ► 0. 

n— >+oo 



m d n b n < max | \[b~ n , y -0 ( 

We have also 

m d n > (y b n 2d ) > ^-yV ( m n) since b n 2d < m n . 



Finally, we obtain 

4- E N d «i,oc(N)< V^KO — — ^o. 



The proof of Lemma [2] is complete. 
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